DOCUMENT RESUME 



ED 344 944 



TH 01B 345 



AUTHOR 
TITLE 

INSTITUTION 
REPORT NO 
PUB DATE 
NOTE 

AVAILABLE FROM 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



Zeng, Lingjia 

Standard Errors of Linear Equating for the 
Single-Group Design. 

American Coll. Testing program, Iowa City, Iowa. 

ACT-RR-91-4 

Aug 91 

22p. 

American College Testing Research Report series, 

Box 168 1 lava. City, IA 52243. 

Reports - Evaluative/Feasibility (142) 



P.O. 



IDENTIFIERS 



MF01/PC01 Pius postage. 

Comparative Analysis? Computer Simulation? "Equated 
Scores? Equations (Mathematics); "Error of 
Measurement? "Estimation (Mathematics)? Higher 
Education? Mathematical Models; "Research Design? 
"Sample Size; statistical Distributions 
Beta Binomial Test Model? "Linear Equating Method; 
"Single Group Design 



ABSTRACT 

Large sample standard errors of linear equating for 
the single-group design are derived without making the normality 
assumption. Two general methods based on the delta method of M. 
Kendall and A. Stuart (1977) are described, one method uses the exact 
partial derivatives, and the other uses numerical derivatives. 
Simulation using the beta-binomial model (500 replications) and real 
test data (a 150-item test divided into 2 half tests) are used to 
evaluate the behavior of the estimated standard errors. Comparisons 
with standard errors derived with the normality assumption and 
bootstrap method are also conducted. The results indicate that the 
standard errors derived in this paper agree with those computed by 
the bootstrap method and are more accurate than the standard errors 
based on the normality assumption, especially in the situation in 
which the score distributions are skewed. Five tables present results 
of analyses. There is a 13-item list of references. (Author/SLD) 



**•****•***«••«** ********* ****^*******n*n*******f,^*i,**i,m •***»«*****„»* 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 



ACT Research Report Series 



91-4 



Standard Errors of Linear 
Equating for the Single-Group 
Design 



Lingjia Zeng 



U S DEPARTMENT OF EDUCATION 

0**f* ot £ tfm-»t»onai R*aeaTh &™3 )mD*&v&™ert 

EDUCATIONAL RESOURCES INFORMATION 
CENTf RtERC* 

*/rn>s document ftas 'epuxluctKJ as 

recced t'om person ™ organization 
originating it 

i • M»nof ranges ***e been mad* tf> »mpfo*« i 
ri»prwdwci«oo qv*»i?y ^ 

• Prvnts of i* option* Mated m tNs dor u 
mpn! rto no? nftce»W»«¥ reprint oW«:i*i 
Ot »f p«»»1»o" O' poUry 



'PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (£RtC). M 



August 1991 



For additional copies write: 
ACT Research Report Series 
P.O. Box 168 
Iowa City, Iowa 52243 



$ 1991 by The American College Testing Program. All rights reserved. 

3 



0 

ERIC 



Standard Errors of Linear Equating for the Single-Group Design 



Lingjia Zeng 



American College Testing 
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Abstract 



Large sample standard errors of linear equating for the single-group design are derived 
without the normality assumption. Two general methods based on the delta method are 
described. One method uses the exact partial derivatives, and the other uses numerical 
derivatives. Simulation and real test data are used to evaluate the behavior of the estimated 
standard errors. Comparisons with standard errors derived with the normality assumption and 
bootstrap method are also conducted. The results indicate that the standard errors derived in this 
paper agree with those computed by the bootstrap method and are more accurate than the 
standard errors based on the normality assumption, especially in the situation in which the score 
distributions are skewed. 
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Standard Errors of Linear Equating fjr the Single-Group Design 

In linear equating, scores on one test form are transformed linearly to scores on the scale 
of another form. The purpose of linear equating is to adjust for presumably small differences in 
test difficulty between the two forms of the same test. The single-group design is one of the 
basic data collection schemes. In this design, examinees are administered both forms of a test to 
be equated. An advantage of this design is that the equating errors are relatively small 
compared to that of some other designs. However, the order of administering the two forms 
may have an influence on the examinees' performance. For example, if familiarity with the test 
increases performance, then the form administered last would appear easier than the form 
administered first, supposing the two forms are equally difficult. Such an effect is usually 
referred to as a practice effect. One way to minimize the practice effect is to administer the two 
forms, say, A and B, in a way such that a random half of the examinees take Form A first and 
another half of the examinees take Form B first. Thus, the order of administration of the two 
forms are counterbalanced. Lord (1950), Angoff (1 984), and Petersen, Kolen and Hoover 
(1985) have presented descriptiuns of this design. Holland and Thayer (1990) addressed the 
issue of counterbalancing in detail. 

Because equating is usually conducted using a sample of examinees drawn from a 
population, the results are subject to sampling error. The errors of equating can be quantified 
using standard errors. Standard errors of linear equating for the single-group design were 
derived by Lord (1950) under the assumption that the two test scores have a normal bivariate 
distribution in the population from which the sample is drawn. Because skewed score 
distributions are typical in many testing programs (Kolen, 1985), the normality assumption is 
seldom met. However, the standard error of equating for the single-group design with less 
restrictive assumptions has not been derived. Braun and Holland (1982) derived standard errors 
for the random groups design, and Kolen (1985) derived standard errors for the common-item 
nonequivalent-groups design, without making the restrictive normality assumption. Their 
results suggested that standard errors of linear equating based on the normality assumption 
might produce misleading results when score distributions are skewed or more peaked than a 
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normal distribution. The purpose of this paper is to derive large sample standard errors of linear 
equating for the single-group design without making the normality assumption. Two general 
methods based on the delta method (Kendall and Stuart, 1977) are described. In one method the 
exact derivatives are used and in the other the numerical derivatives are used. Simulation and 
real test data are used to evaluate the behavior of the estimated standard errors. A comparison 
with standard errors derived with the normality assumption is also conducted. 



MPT* Samp!" Standard Errors 

Kendall and Stuart (1977) described a general method for estimating standard errors of 
functions of random variables by means of a Taylor expansion. This method is usually referred 
to as the delta method. According to Lord (1950), the linear equating function for equating two 
test forms, X and Y, under the single-group design can be written as 

/|x!n(X).o2(X).u(Y).a2 (Y )]=-^- ) lx -u(X)l + U(Y). CD 

C5(X) 

It is assumed here that the form taken first has no effect on the performance on the form taken 
last. Let 8i, 02, 63. and 84 be alternative names for the four parameter u(X), o 2 (X), n(Y), <J 2 (Y) 
in function /, and let their estimates be §1 , 82, §3. and 84. Define t as an estimate of / that uses 
the estimates of the parameters in Equation 1 . According to the delta method described by 
Kendall and Stuart (1977) the sampling variance of f can be expressed as follows: 



varjf (x)| = £ <7T) 2 var(§,) + I I TT* 7T~ cov(8j,8j) + remainder. (2) 
i=l i=l #T=1 d& i de i 

The term "remainder" in Equation 2 refers to higher order terms in the Taylor expansion that are 
small and thus can be ignored. 

The standard error of equating SHI? (*)| Is the square root of varjf (x)J. To compute 
var|? (%)). we need to find the four first partial derivatives with respect to each of the four 
parameters, the four sampling variances and 12 covariances of the four parameters. These 
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sampling variances and covariances are listed in Table 1. Because cov(8j,8j) = cov(8j,8i), only 
six different covariances are listed. The calculation of the sampling variance iff (x), without 
assuming a normal distribution, involves estimating higher order central monicnts and cross- 
product moments. Because the higher order moments are very sensitive to sampling variation a 
large sample size might be required to ensure accurate estimates of standard errors. So if the 
sample size is not large enough the standard errors computed from Equation 2 might not be 
accurate. 



Insert Table 1 about here 



The first partial derivatives of / with respect to each of the four parameters in the 
equating function are derived as follows: 

dl _ qOO 

ae 3 ' C5) 

and 

it 4 = 2cT(X)a(Y) |X " M(X),= 2^ Z ' < 6 > 
x - U(X) 



where Z = 



tJ(X) 



Substituting the four partial derivatives into Equation 2, a formula for computing the 
sampling variance of linear equating for the single-group design is obtained as follows: 
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varlf (x)J = Z2 { ^D- var[c2(X)] - -f-covtc2(X),o2<Y)l + varlo-2(Y)l } 

^X) 2o2(X) 4ty2(Y) 

+ Z{^covlf(X),o2(X)]- -i-covl(l(X)A2(Y)]. ^covtf(Y),a2(X)] 

CT 3 (X) O(X) O^X) 

♦ — covlA(Y),o2(Y)]) + ^v a ^I^(X)^^cov[^(X),^l(Y)] + vart^l(Y)], (7) 
a(Y) <j2<X) o(X) 



where Z is the same as defined in Equations 4 and 6, the var's and cov's are defined in Table 1 
under the label of "general". 

The partial derivatives can also be computed numerically. Lord (1950) used numerical 
derivatives in the computation of asymptotic sampling variance. Let fi denote the entire vector 
of values Bj, i=l to 4. Then the first partial derivatives of function / with respect to 9j can be 
approximated by 



where & is the ith row of the diagonal matrix &, where 



'hi 

h 2 



h4 -I 



and 0(h 2 ) is the error of approximation. Because Equation 8 is derived by expanding i(xlfi) 
at two neighboring points (0 + &) and (9_ - £i) with a second order Taylor's series, the 
magnitude of the error is based on the magnitude of the third partial derivative. If the third 
partial derivative with respect to 8j is zero, then the first partial derivative with respect to 0j 
approximated by Equation 8 is the exact value. For example, approximate d / / £83 as 
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d8j " JM(Y) ~ 2hi 

which is the exact derivative defined by liquation 5. Alternatively, if the function has a nonzero 
third partial derivative, then error will be involved in the approximation. The error of 
approximation is bounded by C h^, where C is the maximum absolute value of the third partial 
derivative with respect to ©j. Equation 8 suggests that the numerical derivative approaches the 
exact derivative as hj approaches /.em. But in actual computation, a too small hi cannot be 
used, because h; is used as a denominator. If the denominator is too small, the computer 
rounding error will become significant. As a result, the obtained numerical derivative may be 
incorrect. In present paper, hj is set to 6, /1O00. This value was selected to yield desirable 
accuracy. More detailed discussion of numerical derivative with more than one variable can be 
found in many advanced calculus textbooks (e.g., Taylor and Mann, 1983). 

In the present paper, the delta method is implemented using Equation 7, which uses the 
exact derivatives, as well as using Equation 2 with numerical derivatives approximated by 
Equation 8. Note that many of the expressions are presented with population parameters. In 
actual computation, the sample estimates for the parameters are substituted h the formulas. 

SE Based on the Norma lity Assumption 

If the score distributions of Forms X and Y are assumed to be bivariate normal, then the 
sampling covariances cov$(X),c2(X)l, cov#(X),o2(Y)J, cov^(Y),o 2 (X)l and 
covJn(Y),o2(Y)] have zero values (Kendall, and Stuart, 1977, p. 85), The variances and 
covariances based on the normality assumption are listed in Table 1 under the label of 
"Normal". Substitute these variances and covariance and the exact derivatives into Equation 2 



to obtain 
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* , o2(Y) o2(X) 0 2 (Y) _ 2 2a«X) C 2 (Y) __1_ 2 2^00 



q(Y) g(X,Y) o(Y) 1 g 2g2(X,Y) 
o(X) n " 2o2(X) 2ci(Y) n 

. 1 J2o 2 (Y) ♦ « Y) Z2 - 2 - SSEm^ (9) 

« a(X) o 2 (X) 

Substituting p, v = into the above expression gives 

* P * y a(X)a(Y) 

varlf (x)} = ^p- 12 + Z2 - 2p xy - P 2 xy Z 2 1 = ^ (1 - p, y ) IZ 2 (1 + p X y) + 2 ] (10) 

Equation 10 is the same as the standard error formula derived by Lord (1950) with the normality 
assumption. The standard error of equating is the square root of varlf (x)]. Equation 10 is valid 
only in the situation in which the distributions of X and Y are bivariate normal 

Computer Simulation 

A computer simulation was conducted to study the behavior of the standard errors of 
linear equating for the single-group design. Simulated scores were geneiated to reflect two 
kinds of testing situations. In the first situation, the score distribution is nearly symmetric and 
the simulation Is referred to as the nearly symmetric simulation. In the second situation, the 
score distribution is negatively skewed and the simulation is referred to as the nonsymmetric 
simulation. The beta-binomial model (Lord & Novick, 1968, chap. 23) was selected to generate 
observed scores. For the nonsymmetric simulation, the beta true score distributions were 
assigned parameters 20.7 and 7 to simulate the score distributions similar to those of a real 
professional certification examination (see the example used in next section of this paper). 
These parameters were selected through a trial-and-error procedure. For the nearly symmetric 
simulation the beta true score distributions were assigned parameters 15 and 14.5. Both tests 
were simulated to have 75 items. The simulation was conducted using the following steps: 
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1) Randomly generate a beta variaie using the parameters associated with the desired 
distribution. This beta variate,/?, represents an examinees proportion-correct true score. An 
algorithm described by Cheng (1978) was used to genets the beta variate. 

2) Given the proportion-correct true score, p, in step 1 , randomly generate two binomial 
variates with the number of trial parameter equal to 75. These two binomial variates represent 
observed scores on two 75-item Forms, X and Y, respectively. A function called BNLDEV 
described in Numerical Recipes (Press, Flannery, Teukolsky & Vetterlin, 1990, p. 218) was 
used to generate the binomial variates. 

3) Repeat steps 1 and 2 n times, where n represents the sample size used in the 
simulation. Thus, a set of n pairs of observed scores for Forms X and Y were obtained. / 

4) Equate Forms X and Y using the data resulting from step 3. Compute the Y 
equivalent of X at the selected X levels, and compute the standard errors using the following 
three methods: (a) with the normality assumption; (b) the delta method with numerical 
derivatives; and (c) the delta method with exact derivatives. 

This process was replicated 500 times. The Form Y equivalents and the three standard 
errors at the selected X levels were averaged over the 500 replications. The "true" standard 
errors of equating were computed The "true" standard error of equating for a given score on 
Form X was defined here as the standard deviation of Form Y equivalents of that score over the 
500 replications. The simulation was conducted using sample size of 100 and 500 examinees. 

The descriptive statistics for the simulated observed score distributions are listed in 
Table 2. These statistics are the averages computed over the 500 replications. The means for 
Form X are slightly higher than those for Form Y. In the nonsymmetric simulations, the score 
distributions are negatively skewed. 



Insert Table 2 about here 



The results of the simulation are summarized in Table 3 at the selected Form X score 
levels. The standard errors estimated by the three methods are the average values over the 500 
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replications. The accuracy of the three standard errors can be evaluated by comparing the bias 
which is the difference between the "true" standard error and the average standard errors 
estimated by the three methods. The standard deviations of estimations are also listed in 

w 

Table 3. 

All the standaid errors listed in Table 3 show a general pattern of the standard errors 
being smaller near the mean of the score distribution than at the extremes. Also, the standard 
errors become smaller as the sample size gets larger. 



Insert Table 3 about here 



The standard errors computed by the delta method with numerical and exact derivatives 
are almost identical at all selected score levels in both the nearly symmetric and nonsymmetric 
simulations. In the nearly symmetric simulations, the simulated score distributions are very 
close to the normal distribution. The standard errors based on the normality assumption are 
very close to those calculated without normality assumption (see Table 3). In the simulation 
with the smaller sample size (n=100), the standard errors based on the normality assumption are 
closer to the "true" values than those without the normality assumption. But in the simulations 
with a larger sample size (n=500), the standard errors computed by the delta method are closer 
to the "true" values than those based on the normality assumption at most of the selected score 
levels. 

In the nonsymmetric simulations, the differences between the standard errors based on 
the normality assumption and those without normality assumption are larger than those in the 
nearly symmetric simulations (see Table 3). The standard errors computed by the delta method 
are very close to the "true" values, and the standard errors based on the normality assumption 
are more biased. The method based on the normality assumption tends to underestimate the 
standard errors at lower scopes and to overestimate them at higher scores for the negatively 
skewed score distribution. 
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The standard deviation of the estimated standard errors computed over the 500 
replications is a measure of variability in estimating standard errors. The simulation results in 
Table 3 indicated that the standard errors estimated by the formula based on the normality 
assumption are generally less variable over the 500 replications than those based on the less 
restrictive assumption. An explanation given by Kolen (1985) is that the normal standard errors 
requires estimation of only means and variances, whereas the estimation of nonnormal standard 
errors requires the estimation of these parameters as well as high-order central moments and 
cross-product moments. Because high-order central moments and cross-product moments are 
very sensitive to sampling variation, the estimation of nonnormal standard errors arc more 
variable over the replications. 

A Real Data F^mpfp 
Data from a 150-item multiple-choice professional licensure examination were used in 
this example. The 150-item test w?s divided by odd-even splits into two half tests. These two 
half tests were designated as Form X and Form Y. Each form consisted of 75 items. Data 
obtained from 500 examinees were used in this example. The descriptive statistics for the 
sample are listed in Table 4. The mean scores for both forms indicate that approximately 73 
percent of the items were answered correctly on average. The score distributions of both forms 
are considerably skewed. 



Insert Table 4 about here 



Bootstrap standard errors were also computed from 1000 bootstrap replications using 
the procedure described by Kolen (1985). Efron (1982) presented a variety of examples in 
which standard errors computed from bootstrap method were more accurate for small sample 
situations than standard errors based on the delta method. In the present paper, the bootstrap 
standard errors are used for evaluating the accuracy of standard errors based on the normality 
assumption and standard errors without the normality assumption. 
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Results from linear equating and standard errors of equating computed in four different 
ways at the selected score levels are given in Table 5. The standard errors computed using the 
delta method with numerical cerivatives are almost identical to those using the delta method 
with exact derivatives at all the selected score levels (the maximum difference is 0.001). The 
standard errors calculated without the normality assumption are very close to the bootstrap 
standard errors. In fact, the standard errors computed using the two delta methods agree with 
those computed by bootstrap method to two decimal places. In general, the standard errors arc 
the smallest near the mean, and become larger farther away from the mean. The standard errors 
based on the normality assumption are smaller at the lower scores and larger at the higher scores 
than those for the other methods. 



Insert Table 5 about here 



Disf tissinn gnrt Conclusion 

Three methods of estimating standard errors of linear equating for the single-group 
design were compared in this paper by using simulation and real test data. The results of the 
simulation suggest that when the score distributions are symmetric or nearly symmetric the 
standard errors computed based on the normality assumption and the delta method with 
numerical and exact derivatives are very similar to each other. When the score distributions are 
skewed, the results obtained from both the simulation and real data suggest that the standard 
errors derived without the normality assumption are less biased than those based on the 
normality assumption. In terms of variability in estimation, the standard errors based on the 
normality assumption are less variable than those derived without such an assumption. 

The bootstrap method can yield accurate estimates of standard errors. However, the 
bootstrap method is very time consuming, because the number of resamplings must be large for 
the bootstrap standard errors to be accurate. The delta methods might be preferable because 
they yield accurate results with considerably less computation. 
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The standard errors computed by the delta method with numerical and exact panial 
derivatives were almost identical. The advantage of using the exact partial derivatives is that an 
equation can be provided for calculating the standard errors. But the delta method with 
numerical derivatives is often much simpler to compute and to program on a computer than the 
method with exact derivatives. This advantage is not that pronounced in computing the standard 
errors of linear equating under single-group design, because the linear function for this design is 
simple and involves only four simple first-order partial derivative. But for some more 
complicated equating designs, like the common-item nonequivalent-group design (Kolen, 
1985), using numerical derivatives has the capacity to make the computation dramatically less 
complicated than using the exact derivatives. 

Another advantage of using numerical derivatives is that it is easier to develop a general 
computer algorithm for computing the standard errors of equating with different methods (Lords 
1975). A major task in deriving standard errors of equating with the delta method is to derive 
the partial derivatives with respect to each parameter involved in the equating function. For a 
different equating method a different set of partial derivatives need to be derived. If numerical 
derivatives are used there is no need to derive analytical formulas for all the panial derivatives. 
Thus, a general computation algorithm can estimate standard errors for different equating 
methods by just changing the equating function accordingly. The delta method with numerical 
derivatives might also prove useful for estimating standard errors under complicated designs 
such as chains of equatings. 
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Table 1. Sampling Variances and Covariances of Bivariate Moments 



Statistics) Sampling Variances and Covariances 

General Normal 



var£(X)J 


<y2(X)/n 


o2(X)/n 


var[a 2 (X)] 


{E[x-n(X)]4-o4(X)}/n 


2o 4 (X)/n 


var£<Y)l 


<y2(Yyn 


02(Y)/n 


varla^Y)] 


{E[y-|KY)]4-o*(Y)}fc 


2a4(Y)/n 


cov£(X),(i(Y)l 


a(X,Y)/h 


a(X,Y)/n 


cov#(X),&2(X)J 


EIX-^(X)l3/n 


0 


covlA(X),a2(Y)] 


E[x-n(X)][y^(Y)l2/n 


0 


cov{o2(X),o2(Y)l 


{E{x-ji(X)]2 [y-n(Y)l2 - <j2<XXj2(Y)}/n 


2a2(X,Y)/n 


cov[a2(X),(i(Y)] 


{E[x-n(X)l2ly-n(Y)]}/n 


0 


cov£(Y),o2(Y)l 


Ely -H(Y)]3/n 


0 



Note: The terms in the body of the table were adapted from Kolen (1985), and are typically 
based on large sample theory. E refers to expected value, n is the sample size. 
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Table 2 Descriptive Statistics of Simulated Scores 



Form 



mean 



s . d. 



Nearly Symmetric, n=100 



X 
Y 



39.46 
38.84 



7.95 
7.93 



Nearly Symmetric, n=500 



X 

y 



39.41 
38.82 



Non symmetric, n=100 



X 
Y 



57.30 
56.71 



Nonsymmetric, n«=500 



X 
Y 



57.30 
56.72 



8.00 
8.00 



6.71 
6.71 



6.78 
6.80 



akewness 



■0.04 
■0.03 



-0.04 
-0.04 



■0.42 
-0.41 



-0.44 
-0.43 



kurtosis 



-0,23 
-0.24 



-0.21 
-0.20 



0.04 
0.02 



0.07 
0.07 
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Table 3. Results for Two Simulations at Two Sample Sizes 



f(x) 



Standard Errors Standard Deviation 

of Estimates 

'true' Norm. Num. Exact Norm. Num. Exact 



Nearly Symmetric Simulation 
n = 100 



10 


9.35 


2.173 


2. 


097 


2.048 


2 


.049 


0 


.2069 


0.2778 


0.2779 


20 


19.36 


1.519 


1. 


442 


1.427 


1 


.427 


0 


.1422 


0.1945 


0.1946 


30 


29.37 


0.933 


0. 


858 


0.869 


0 


.870 


0 


.0813 


0.1127 


0.1127 


40 


39.38 


0.641 


0. 


602 


0.597 


0 


.597 


0 


.0481 


0.0494 


0.0494 


50 


49.39 


0.963 


0. 


980 


0.912 


0 


.912 


0 


.0954 


0.1166 


0.1167 


60 


59.40 


1.556 


1. 


590 


1.479 


1 


.480 


0 


.1563 


0.1943 


0.1943 


70 


69.41 


2.212 


2. 


252 


2.104 


2 


.105 


0 


.2210 


0.2761 


0.2763 


80 


79.41 


2.888 


2. 


930 


2.746 


2 


.748 


0 


.2874 


0.3605 


0.3607 



n = 500 



10 


9.38 


0.912 


0.935 


0 


.923 


0. 


923 


0 


.0414 


0 


.0529 


0 


.0529 


20 


19.38 


0.633 


0.643 


0 


.643 


0. 


643 


0 


.0285 


0 


.0365 


0 


.0365 


30 


29.39 


0.386 


0.383 


0 


.392 


0. 


392 


0 


.0164 


0 


.0207 


0 


.0207 


40 


39.40 


0.278 


0.271 


0 


.269 


0. 


269 


0 


.0094 


0 


.0092 


0 


.0092 


50 


49.41 


0.429 


0.439 


0 


.411 


0. 


411 


0 


.0189 


0 


.0241 


0 


.0241 


60 


59.42 


0.686 


0.711 


0 


.666 


0. 


666 


0 


.0311 


0 


.0403 


0 


.0403 


70 


69.43 


0.967 


1.006 


0 


.947 


0. 


948 


0 


.0440 


0 


.0569 


0 


.0569 


80 


79.44 


1.257 


1.308 


1 


.236 


1. 


237 


0 


.0572 


0 


.0738 


0 


.0739 



Nonsymmetric Simulation 
n » 100 



10 


9.25 


3 


.562 


3.315 


3 


.423 


3 


.424 


0. 


3472 


0.5527 


0 


.5530 


20 


19.28 


2 


.851 


2.624 


2 


.738 


2 


.739 


0. 


2757 


0.4434 


0 


.4436 


30 


29.32 


2 


.147 


1.941 


2 


.060 


2 


.061 


0. 


2048 


0.3340 


0 


.3342 


40 


39.35 


1 


.459 


1.278 


1 


.397 


1 


.398 


0. 


1352 


0.2245 


0 


.2246 


50 


49.38 


0 


.829 


0.694 


0 


.789 


0 


.790 


0. 


0687 


0.1130 


0 


.1131 


60 


59.42 


0 


.534 


0.558 


0 


.504 


0 


.504 


0. 


0522 


0.0436 


0 


.0436 


70 


69.45 


0 


.960 


1.061 


0 


.921 


0 


.921 


0. 


1084 


0.1209 


0 


.1209 


80 


79.49 


1 


• 611 


1.710 


1 


.551 


1 


.552 


0. 


1747 


0.2225 


0 


.2226 












n = 


500 
















10 


9.24 


1 


.691 


1.473 


1 


.556 


1 


.557 


0. 


0667 


0.1153 


0 


.1154 


20 


19.28 


1 


.356 


1.167 


1 


.245 


1 


.246 


0. 


0530 


0.0928 


0 


.0928 


30 


29.32 


1 


.024 


0.863 


0 


.937 


0 


.938 


0. 


0393 


0.0702 


0 


.0702 


40 


39.36 


0 


.699 


0.569 


0 


.636 


0 


.636 


0. 


0259 


0.0475 


0 


.0475 


50 


49.39 


0 


.394 


0.310 


0 


.359 


0 


.359 


0. 


0130 


0.0240 


0 


.0240 


60 


59.43 


0 


.227 


0.250 


0 


.226 


0 


.226 


0. 


0099 


0.0091 


0 


.0091 


70 


69.47 


0 


.420 


0.472 


0 


.414 


0 


.415 


0. 


0203 


0.0235 


0 


.0235 


80 


79.51 


0 


.728 


0.760 


0 


.700 


0 


.701 


0. 


0329 


0.0440 


0 


.0440 
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Table 4 Descriptive Statistics for 

a Professional Certification Examination 



Form mean S. D. skewness kurtosis 



X 55.694 5.719 -0.657 0.493 

Y 55.594 5.687 -0.527 -0.044 



Table 5 Standard Errors of Linear Equatings for 
a Professional Certification Examination 



x f (x) Boot. Norm. Numer. Exact. 



10 


10.158 


1.578 


1.540 


1.569 


1.570 


15 


15.131 


1.415 


1.374 


1.406 


1.407 


20 


20.104 


1.251 


1.209 


1.244 


1.245 


25 


25.076 


1.089 


1.044 


1,082 


1 .083 


30 


30.049 


0.927 


0.881 


0.921 


0.921 


35 


35.022 


0.766 


0.720 


0.761 


0.762 


40 


39. 994 


0.606 


0.562 


0.604 


0.605 


45 


44. 967 


0.455 


0.411 


0.452 


0.453 


50 


49.940 


0.315 


0.280 


0.313 


0.313 


55 


54.913 


0.214 


0.209 


0.214 


0.214 


60 


59.885 


0.217 


0.255 


0.218 


0.218 


65 


64 .858 


0.320 


0. 377 


0.321 


0.321 


70 


69.831 


0.461 


0.525 


0.461 


0.461 


75 


74.803 


0.615 


0.682 


0.614 


0.614 
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